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In the standard models for optimal multiple stopping problems it is as- 
sumed that between two exercises there is always a time period of deter- 
ministic length 5, the so called refraction period. This prevents the optimal 
exercise times from bunching up together on top of the optimal stopping time 
for the one-exercise case. In this article we generalize the standard model 
by considering random refraction times. We develop the theory and reduce 
the problem to a sequence of ordinary stopping problems thus extending the 
results for deterministic times. This requires an extension of the underlying 
nitrations in general. Furthermore we consider the Markovian case and treat 
an example explicitly. 
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1. Introduction 

o i 

The aim of this paper is to extend the theory of optimal multiple stopping. These 
stopping problems with multiple exercise opportunities arise in different fields of applied 
probability, in particular in the analysis of options traded on the energy market. For 
example swing options entitle the buyer to exercise a certain right n times in a given 
time interval. The buyer of the option is faced with the following optimization problem: 
What are the best times to exercise these rights? This leads to the problem 

Maximize K(Y(ti) + ... + Y(r n )) for (n, r n ) with T\ < ... < r n . 

Without any further restrictions one can see that the optimal strategy is to exercise 
all rights at that same time, namely at the time when one would exercise for n = 1. 
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But typically there are restrictions imposed on the exercise dates. The most relevant 
restriction is that between each two exercise times there must be a pre-specified time 
interval, the so called refraction period, of length 5, i.e. Tj + 8 < r i+1 for all i. 
In the existing models for such situations it is assumed that 8 is a given constant, see 
e.g. [CT08], but in real world situations random waiting times might arise. So, in this 
article we introduce random waiting times 8i, 8 n -±. For dealing with this extended 
problem we note that the optimal strategies 7$, i > 2, will depend on the values 8i, 8^1, 
therefore we have to enrich the standard filtration to include the information given by 
the random waiting times. This is carried out for the continuous time case in Section [2] 
and first properties of the enriched filtration are noted there. 

The main tool for a solution of optimal multiple stopping problems lies in the reduction 
of the original problem to a sequence of n ordinary optimal stopping problems. This 
approach is well known for the problem with deterministic waiting times, see e.g. [BS06, 
Section 2] and the references therein for the discrete time case and [CD081 , Proposition 
3.2] and |CT081 Theorem 2.1] for the continuous time case. An extension to a more 
general situation can be found in [KQRM11|. This reduction can be used to apply known 
techniques for ordinary optimal stopping problems to solve multiple stopping problems 
(semi-)explicitly or numerically, see e.g. [JRT04], |Tho95] and [MH 04J . also [Bcn llb] 
and [Benllaj . We establish such a reduction principle in Section [3] and furthermore 
carry over the results to the discrete time case. In Section 0] we establish the theory for 
underlying Markov processes. We treat an example in Subsection 14.11 where we can find 
the explicit solution. 

In SectionOwe introduce a second model that covers other classes of real-world problems, 
such as employee options. The basic idea is that additionally to the reward process 
another process is running, and it is only possible to exercise again when the second 
process enters a given set B. We develop the theory, but because this model is easier 
to handle and many ideas are similar to the arguments given before we just sketch the 
proofs. We use these results for treating an example with explicit solution in Section EJ 
This is remarkable since in the theory for deterministic waiting times no such examples 
seem to be known. 

2. The model and first properties 

For the following we fix a probability space (Q, J 7 , P) and a filtration J = (J~t)t>o fulfilling 
the usual conditions, i.e. $ is right-continuous and contains all P-null-sets. Further- 
more let Y = (Y(t))t>o be an ^-adapted, non-negative and right-continuous stochastic 
process with the property 



We denote by S the set of all ^-stopping times with values in [0, 00] and write 




(1) 



S a :={reS; r> a} 
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for all a G S. Note that the value oo is admitted. Furthermore, we write 



Moreover we fix a number n that represents the number of exercise opportunities. As 
discussed in the introduction, between each two exercise times and Tj+i we have to wait 
at least Si time units. Now we assume 5 1 , ...,5 n _i to be non-negative random variables 
which are finite a.s. In this case the holder of the option has to use the information 
given by the waiting times for the next decision. This information is a priori unrelated 
to the information given by the filtration Hence $ is not the adequate filtration for 
formulating the multiple optimal stopping problem with random waiting times: 
If the holder of the option exercises the first time using the strategy T\ and waits for Si 
time units, then the information available at time t is given by J- t U{{ri+5 1 < s}; s < t}. 
Hence for the strategy Ti the holder has this information at time t, i.e. Ti should be 
modeled as a stopping time with respect to (o(Tt U {{ti + Si < s}; s < t})) t >o- In 
the following subsection we study this filtration in detail before formulating the multiple 
optimal stopping problem with random waiting times in this model. In order to enhance 
readability, some proofs are are given in an appendix. 

2.1. Exercise strategies with random waiting times 

For shorter notation we use the following definition: 

Definition 2.1. For each p : Q — > [0, oo] let Q p be the smallest filtration such that p is 
a stopping time, i.e. 

Qt = PK^*> ^ = ("4s)«>o i s a filtration and p is an ^-stopping time}, t > 0. 

For example if p is an J-'-stopping time, then C/f C Tt for all t > 0. In particular if p 
is a constant, then = {0,f2}. Furthermore one immediately checks that 



Definition 2.2. For each filtration 21 = (At)t>o an d each p : Vt — > [0, oo] let % p = 

(At )t>o be the smallest right- continuous filtration containing 21 such that p is a stopping 

time, i.e. 2l p the right- continuous filtration generated by filtration (a(A t ,Gt)) 

\ J t>o 

Furthermore for all p 1 , p n : Vt — > [0, oo] define recursively 



c( Ut>o^) an d Y(+oo) := limsupF(t). 




(2) 



(3) 




The following proposition lists some properties of 2l p for later use. 



Proposition 2.1. With the notation given above it holds that: 



(i) W = 2t ; if p is an ^-stopping time and 21 is right- continuous. 
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(ii) g p t _ s = g p t +s and A p t _ s Q A p t +S for all s < t. 



ere 



(Hi) At \{ a = T } = At \{a-=r} for all t > and %-stopping times a and t, wh 
C \ D := {C fl D; C EC} for all a-algebras C, D C Q. 

(iv) Af +P D A T t +p for all t > and stopping times o < t with countable range. 

Proof. See\KJ\ □ 

Now we come back to the model described at the beginning of this section by intro- 
ducing the strategies: 

Definition 2.3. Write 5 := (8%, ...,5 n _i) for short. For each ^-stopping time o define 

S™(5,$) :=/(ti, ...,T n ); ri is ^-stopping time and o < n, (4) 

Ti is ^ Tl+5l '"' ,Ti ~ 1+Si ^ 1 -stopping time 
and t^x + Si-i <n,i = 2, ...,n 

and 

S™(5,$) disc :=|(ri, ...,r n ) G S%(5,$); range(rx) is countable^. (5) 

We also write S%{8) := S%{6,$) and S"(<5) disc := «Sg(£,ff) disc for short. The notation 
is a direct generalization of that given, e.g., in [C T08] for deterministic 5 since from 
Proposition 2.1 it follows 

S:(6) = {r e S n ; <7<ri, r f _i + <J i _i<r i ,i = l,..,n} 

if 5i, <5 n -i are ^-stopping times, in particular if 8 — 5\ — ... — 5 n _i are constants. 
The following lemma summarizes some useful facts for later use. 

Lemma 2.2. Let a and r be ^-stopping times and write LS := (62, ...,<5 n _i). 

(i) It holds that 

S n M) ={(r 1 ,...,r n ); r x G S a , (r 2 ,...,r n ) G <Ss~+ T1 (L8, ^ T1+Sl ) | 

and 

S?0*,3)dtoc ={(ri,...,r n ); n G <S CT)disc , (r 2 ,...,r n ) G ^(^r^)}. 
For a// (r 2 , ...,r n ) G 5££ $ T+Sl ) and A> it holds that 

(V 2 l {T=A} +(A+o\)l {r ^A},---,T„l {r ^^ d X+Sl ). 
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(in) For all (r 2 , ...,r n ) G 5"+^ £ A+51 ) # ftotas tfia£ 

V{r=A} + (T+5l)l { ^} I --- 1 Tj {T= A} + (r+^+...+C 1 )l {r ^})e5^(Mr il ). 

fwj For a// (r 2 , ...,r n ) G 5££ (L5, $ T+Sl ) and c> 

(r 2 + c, r n + c) G ^ +c+51 )- 

Proo/. See [AH □ 

Remark 2.3. a /irs£ glance one might think that the set <S™(5, z's closed under 
taking (component wise) maxima. This is not true in general: Indeed if p\ and t% are 
^-stopping times with p\ > t\, t 2 is an $ T1+Sl -stopping time and p 2 an $ P1+Sl -stopping 
time with p 2 < r 2 and r 2 is not an $ pl+Sl -stopping time, then p 2 V r 2 = r 2 is not an 
y(pivn)+*i = stopping time. 

On the other hand if 8\, 5 n _i are $ -stopping times, then this property obviously holds. 

2.2. Formulation of the problem 

Using the notation given in the previous subsection we can state the problem of optimal 
multiple stopping with random waiting times: 
Maximize the expectation 

over all (Yi, ...,r n ) G Sq(5,$). To treat this problem we extend it in the usual way as 
follows: 

Definition 2.4. For each ^-stopping time a write 

Z n (a) := Z 5 J(a) : = esssup e( fy^) F a ) (6) 
t&S?(«,3) \ i=1 / 

and 

^n(o")di SC := ^n 5 ( cr )^ c := esssup El ^ ^( r ) • ( 7 ) 

Furthermore let Z (a) = Z (o-)di S c := 0. 

We immediately obtain 
Proposition 2.4. For all ^-stopping times a it holds that 

(i) Z n (a) disc < Z n (a). 

(ii) If Si, ...,<5 n _i are ^-stopping times, then there is equality in (i). 
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Proof, (i) is immediate since <S"(5, #)disc 5£(<J, 5). 

For (ii) let r G <S"(5, Take a sequence (t^)/.^ of ^-stopping times with countable 
range and 1 ri for /c — )• oo. For each fcGN define 

ffc := r\ and f^ +1 = max{f£ + 5 h r i+1 }. (8) 

Then (fjj, f£) G 5™(<5)di S c f° r all A; G N and (f£)fc e N converges to T{ a.s. for all % G N<„. 
Therefore 



e( X)y(r<) j;)= hm e( fy(f|) j- ct )< esssup if f^fo) j;)< z 

W / S ;=1 / ^(5) dlsc V i=1 / 



□ 



3. Reduction principle for the problem 

To develop the theory of multiple optimal stopping the following lemma is fundamental: 
Lemma 3.1. The sets 



E (E^)|^); r G S5{8)\ and {e^^tO^); r G S t 



disc 



are directed upwards; here an ordered set M is called directed upwards if for all a,b G M 
there exists c G M such that max{a, b} < c. 

Proof. See [O] 

Now we can formulate the first step in the reduction of the problem: 
Theorem 3.2. For each ^-stopping time a it holds that 



□ 



Z s /(a) = esssup e(V(t) + E(Z™f +fl (r + 8 1 )\J C T 



and 



Z^(cT)disc = esssup E F(r) +E(Z^ + "(t + ^OIJ; 



(9) 



(10) 



Proof. We only prove the first statement, the second one may be proved in the same 
manner. 

Let (t 1 ,...,t ti ) G S™(5,$). By Lemma 12721 (i) it holds that T\ G S a and (r 2 ,...,r n ) G 
Ss~+ T1 (LS, d Tl +Sl ) • Therefore 



i=l 



E 



y(n) + E 



8=2 



Tl+(5] 



< E(y(r 1 ) + zSr^(r 1 + 5 1 ; 

F(r 1 )+Efef 1+il (r 1 + 5 i ; 



E 



< 



esssup e(y(t) + E(Z^f r+61 (r + 5 X )\F T 



res CT \ 



^ ■ 
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To prove the other inequality let n G S a . Since the set 



8=1 



is directed upwards by Lemma I3TT1 there exists a sequence (r fe )fc e N G (iS"(5)) N such that 

K — ^OO \ ■ -i / 

1 = 1 



see e.g. |PS06l Lemma 1.3]. Since (ri,r 2 fc , ...,r^) G S%(8,$) for all fc G N by Lemma E 
(i) we obtain 



Z s *(a) > limsupE(y(ri) + £y(^ 



limsup E 



y(n) + E E y (-rf) 



2=2 

n 



n+5 



E F(n) + lim | E VF(rf 
E(V(r 1 ) + Z^f 1+6l (r 1 + 5 1 ) 



E(F(r 1 )+E(Z n L !f 1+4l (r 1 + ( 5 1 )l^ 



J~ ri+5 



□ 

A technical problem to use the reduction theorem given above is that the mapping 
t H> K(Z^!f + 1 (t + does not have to be right-continuous. We overcome this 

problem by giving a right-continuous modification, compare [CD08] . To this end we 
need the following lemmas: 

Lemma 3.3. For each ^-stopping time r and all A> it holds that 

l {r =A} Z n J\ (r + Si) = l {r=A } Z n 2\ (A + 
Proo/. Let (r 2 ,...,r n ) G By Lemma 1231 (ii) the random vector 

(P2, — ,/?n) :=^2l{r=A} + (A + 5i)l {r ^ A }, ...,T n l {r=A } + (A + S 1 + ... + 5 n -l)l{r^A} 

is an element of S™^§ (LS,$ x+Sl ). Using this fact together with Proposition 12.11 (iii) we 
obtain 
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i=2 



r+S 1 



E(^l {r=A} y(r,) j£* | {r=A} 



i=2 
n 



/ ™ 

i {t=A} e (JXpO 



-r-A+5i 



l{r=A} J 



i=2 



< l {T=x] Z^t i (A + 5 1 ). 
The reverse inequality holds by the same argument using Lemma 



Lemma 3.4. The process Z n _ x given by 



Z^t) :=E(Z^r i (t + ( 5 1 )|^ 
is a supermartingale with the following properties: 
(i) Z n _i has a right- continuous modification Z£_\- 
(ii) For all ^-stopping times r with countable range it holds that 

tUr) = Zli(r) = E(z^r h (r + 6^ 



m 



□ 



(11) 



(12) 



Proof. For all s < t and r > using Theorem 12.11 (iv) it holds that 



hence 



■pt+S (— -ps+& 



nz S n -At)\F s ) = E(Z^f +h (t + (Ji)l^) 



< E(Z^J +Sl (t + 5 1 )\T s ) 



E(^E 
E( E 



J n-l 



n—1 



esssup E( Y{jj) 



T&S?- s \(L6,r +s i) V i=l 



-ps+Si 



Since the set \ ^\_\Y(ri t 



I3.1[ we obtain 



\i=l 



is upwards directed by Lemma 



E(<_ 1 (t)|J- s ) < E 



esssup E( Y(Tj) 



n-l 



< E esssup E Y ( T i 



i=l 
n—1 



i=l 



-ps+8i 



i.e. the supermartingale property. 
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(i) : Let t > and (t^jkeN a sequence converging to t from above. Since Z & n _ x is a 

supermartingal, the limit lim^-j-oo exists and is bounded above by 

E^_!(t)). For (r 2 ,...,r n ) G ^(L*,^ 1 ) write 

A fc :=t fc -t und r fc := (r 2 + A fe , r n + A fc ) 

for all fcGff. By Lemma O(iv) r k G 3* +Ak +*) = S^ Sl (LS,^ k+Sl ) 

for all fc G N, yielding the inequality 

n n / \ / 

— „ fc— >oo — „ k^oo \ I k~ >oo \ 

i=2 i=2 

Putting pieces together we obtain E^Z^^^)^— >■ E^Z^_ 1 (t) 

(ii) : For all A> we obtain using Lemma [3.31 

l{r=A}^n-l( T ) = !{r=A} ^n-l(^) 



= l {r=A} E(z^f + 1 (A + 50|^ 
= E(l {T=A} Z L Jlf +S \X + JOI-Fa I{.=a } 
= E(l {T=A} Z^f +5l (r + 5 X )|J- T | {r=A} 
= l {T=A} E(^!f +4l (r + 5 1 )|F T ). 
Since r has countable range we obtain (1121) . 

Now we come to the main result: 



□ 



Theorem 3.5. The process Y n :—Y + Z^ r __ 1 is ^-adapted, right continuous and fulfills 

Z S /(o-) disc = esssup E(Y n (r)\F a ) (13) 
res a 

for all a G S. 

If S\, S n -i are J 1 -stopping times, then furthermore 

Z s /(a) = esssup E(Y n (r)\ T a ). (14) 

Proof. Using ffTU]) and ffTIZj) we obtain 

Z S /(a) disc = esssup e(y(t) +E(z^T +h (r + Si)\T T ) T a 

T"G<S CT ,disc ^ 



esssup e(y(t) + Z 5 ^ 1 (r) 
esssup E(F„,(r)|J : ' t7 ) 

TG<S CT ,disc 

esssup E(Y n (r)\J r CT ), 
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where the last equality holds by approximation. (|14|) holds by Proposition 12.41 □ 

By applying the arguments given in the proof of [CD08t Proposition 3.2] to Z^Lx, we 
get 

Corollary 3.6. If S\, S n _i are stopping times, then 

tiW = E(2"i(r + MI^) 

for each $ -stopping time r. 

To end this section we remark how the model with random waiting times in discrete 
time can be found in the model described above. To this end we consider 

T t = Fit}, Y(t) = Y([t\) and ranged), range(5 n _ x ) C N 

for all t > 0. For each (J r fc)fc e N -stopping time a write 

TO 3) :={(n,...,T n ) G S:(5,d); ranged),..., range(r n ) C N }. 

Lemma 3.7. For each (J-k)keN ~ stopping time a: 

(i) T a n (6,d)cSS(6,d) disc . 

(ii) = T[lf ,Pi for each p u ...,p n : Q -> N 0; t > 0, i< n. 

(Hi) ^+^-,n+S i ^ _ 7 rLnJ+«i,...,LnJ+* and ^.j & an $ln}+Si,.,[Ti-i}+Si-x _ stopping time 
for each r G «S£(5,#), t > 0, i< n. 

(iv) ( LnJ , Lr n J ) G 7?(<f, 5") /or eac/i r G 3) . 

Proof. The proof is a straightforward exercise. □ 

So the discrete model may be treated as follows: On the one hand by Proposition 
EH(i) and Lemma 0(1) 

Z s /(a) > Z 5 J(a) disc > esssup e( £y(r,) 
On the other hand using Lemma [3.71 (iv) we have for each r G S™(5,$) 



e( £ y (r f ) = e( £ y ( Lnj ) j;) < esssup e( jr Y( Pl 

Therefore we get for each (.Ffc^^-stopping time ex 

= Z 5 ^(a) disc = esssup e( f^fa) J^V (15) 
rer™(5,5) V i=1 / 
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4. The Markovian case 

In this section we assume (X(t), J-t)t>o to be a strong Markov process with state space 
E and fix a discounting rate (3 > 0. Furthermore let h : E — > [0, oo) be measurable such 
that the ^-adapted and non-negative process 

Y =(e-*h{X{t))) (16) 

is right-continuous, i.e. P^-right continuous for all x £ E and we assume that 



E x supK(t) <oo (17) 
V t>o / 

holds. 

In the following we assume the waiting times 5i,...,6 n -\ to be ^-stopping times. In 
particular we have $n+h>-,Tn-i+6n-i = g f or a u r e Sg(5,$). 



Definition 4.1. For each x £ E let 



T„ ) for all a £ S, 



(i) Z 5 n (a,x) := esssup EJ T,Y{n 
ress(8) \i=i 

(it) V*{x) :=Z s n (0,x), 

(Hi) ~Z 5 n _ l (t,x) := E^Z^t + 5 X iX)\F t ) for all t > 0. 



(iv) Denote the right- continuous modification of Z & n _ x (,x) introduced in Lemma \3.4\ by 
^n'-l(') x )- 

By using the stopping time 5\ instead of the deterministic 5 in the proofs of [CD08, 
Chapter 4], we obtain the following results: 

Lemma 4.1. The function g^_ t : E — y [0, oo) given by 

^-iW:=E,(e-^K L -i(^(^i))) (18) 

is measurable and fulfills the following properties: 

(i) g n _\ is (3 -excessive and C - continuous. 

(ii) The process ie~P t gf l _ 1 (X(t))) is right- continuous. 

V / t>o 

(Hi) For all x £ E and t £ S it holds that 

e-^gt 1 (X(r)) = zt 1 (r,x) F x -a.s. (19) 

□ 
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Theorem 4.2. For the non-negative and Co-continuous function 

h 5 n :=h + g s n ^ 



it holds that 



Z s n (a,x) = esssup E x ( e^ T h 5 n {X(r)) 
reSa V 



T a ) F x -a.s., (20) 



jr a ) F x -a.s. (21) 



in particular 

e -frV*(X{jj)) = esssup E x (e~ f3T h s n (X(r)) 

for all x G E and a G S. □ 

The following lemma shows that the stopping set of the function h given in ffTtjj) is a 
subset of the stopping set given by h 5 n : 

Lemma 4.3. Let g : E — > [0, oo) fre measurable such that (e~ l3t g(X(t)) ) is a right- 

V /t>o 



continuous and non-negative supermartingale with sup t>0 E x ^e /3 *g(X(t))J< oo /or a// 
x G E. Then the stopping set given by h is a subset of the stopping set given by h + g. 

Proof. By the optional sampling theorem for non-negative supermartingales we obtain 
for each x in the stopping set given by h that 

snpE x (e^ T (h + g)(X(r))) < snpE x (e-^h(X(T))) + S npE x (e~ l3T g(X(r))) 
res V / res V / res V / 

= fc(x)+E,(e-*0(X(O))) 

= h(x) + g(x). 

□ 

Corollary 4.4. {x G E; V x (x) = h(x)} C {a; e £; V*{x) = h n (x)}. 
Proof. By (I19|) the process ( e _/3t o^_ 1 (X(t)) J is a right-continuous and non-negative 



-Pt n 8 



supermartingale with sup t>0 E x ^e ^*_ 1 (X(t))J< oo for all x E E. Keeping (12"T1) and 
Lemma [4.31 in mind this proves the result. □ 

Remark 4.5. TTie case of discrete time Markov processes may be treated the same way. 
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4.1. Example: Multiple house-selling problem 

As an application of the theory developed before we consider a multiple-exercise variant 
of the classical house-selling problem. The situation is the following: We would like to 
sell n identical houses and assume that at each time point one offer comes in for one of 
the houses. By Xk we denote the amount of the offer on day k, k = 0, 1, .... For each 
offer we have to decide whether to accept it or not. If we decide to accept the offer, 
then closing the contract lasts a random time 8 > 1, that is assumed to be independent 
of the offers. During that refraction time we cannot deal with new offers. When should 
we accept an offer if we are not able to recall and accept a past offer? 
For the single exercise case the problem was treated in (CRS71] . We model the situation 
in the following way: Let Xq, X%, ... be non-negative iid random variables with E(Xq) < 
oo. The last assertion guarantees that condition ([T]) is fulfilled. Then we consider the 
discrete time stochastic process Y{k) = a k X k , k = 0, 1, 2, where a G (0, 1) is a fixed 
discounting factor. Furthermore, we consider i.i.d. refraction times #i,...,<5 n _i that are 
assumed to be > and independent of (Xq,Xi, ...). Now, the problem is to maximize 
the expectation 

v i=i ' v i=i ' 

over all (ri,...,r n ) e Sq(5, where $ denotes the filtration generated by X ,Xi, .... 
Now, we enrich the filtration $ by Si, <5 n _i, i.e. we define $ by Tk = J r kV&(8i, #n-i)- 
Trivially, the stochastic process Xq,Xi,... is still Markovian w.r.t. Furthermore, 
So&tf) Q So(S,W)- We first maximize Q22) over the set 5^(<J,ff) and then see that the 
maximizer is indeed an element of Sq(5,$). Using Theorem 14.21 we see that 

Z s n (a,x) = esssup E x (a T (X T + g 5 n _ x {X T )) 

where = E x (a s V n _i(Xs)), 5 = S 1 . Conditioning on 5 we see that X$ has the 

same distribution as X\. Therefore, we obtain that 

g s n _ x {x) = E(K-i(X 1 ))E(a 5 ) =: d n -i 

is independent of x. Moreover, 

Z s n (a, x) = esssup E x (a T Z^ 

where Z^~ l = Xk +d n -i. Consequently, we have reduced the multiple optimal stopping 
problem 0221) to the ordinary stopping problem for the case n = 1 with random variables 
with adjusted distributions. The c? n _! are computed successively and at each step the 
distribution is shifted by this constant quantity. Therefore, to solve the general problem 
we only have to consider the problem of maximizing 

E x {a T X T ) 
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over all stopping times r for a sequence of random variables Xi, i = 0,1,2,..., see 
[CRS 71J. It is well-known how to do this. We repreat the simple argument for com- 
pleteness. We denote the value function by v(x). Using the Bellman-principle we see 
that 

v (x) = max{x, aE x (v {X x ) ) } (23) 

for all x. Since oE x (v(Xi)) is independent of x, we see that there exists x* such that 
v(x) = x for x > x*, and v(x) = x* for x < x*, i.e. v (x) = (x — x*) + + x*. Equation 
now yields for x = x* 



x* = oE((Xx -x*) + + x*) 

that is 

Since the right hand side is decreasing in x*, we see that this determines x* uniquely. 
The optimal stopping time is now given by 

ini{k : X k > x*}. 



5. A second model for random refraction times 

For a motivation consider employee options: As a variable component of the salary the 
holder of the option has the right to exercise an option on the companies share price n 
times during a given time period. But the total amount of variable compensations must 
not restrict the institution's ability to maintain an adequate capital base. Therefore the 
holder has to wait between two exercises, e.g., until the liquid assets of the company 
excess a certain level. Of course the waiting time is not deterministic, but random. But 
since the waiting time directly depends on the foregoing exercise time this situation is 
not included in the previous model. Motivated by this example we consider the following 
situation: 

Let £>i, 5 n _i be Borel sets and let X = (X(t)) t > be a further ^-adapted and 
right-continuous process such that for all i < n and s > 

\J{X(t)^Bi} is a P null set (24) 

t>s 

and 

:= inf{t > s; X(t) G Bi} is an ^-stopping time; (25) 
so, refraction times are assumed < oo a.s. Then we consider the problem of determining 

/ n 

Z n (a) = Z*(a) := esssup E ^F(r,) 

reS2(B) \ i=1 

where 

S:(B) := {r G S n ; a < r 1; p% < r t+1 for all i < n}. 
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In the employee option problem described above X is modeled as the liquid assets of 
the company; of course this process is not independent of the gain process Y. Further- 
more Bi, B n _i are bounded intervals of the form [bi, oo). 

As in f ll5p we have: 
Lemma 5.1. (i) We use the notation 

S"(B) disc := {r G S™(B); range(ri), range(r n ) countable}. 
Then for each stopping time a 



Z*(a)= esssup E 

reSS(B) disc \ i=1 



■Fa)', t G z's directed upwards. 



F a ). (27) 



(n) JTie set {E 

\i=i 

Proof, (i) is a straightforward exercise and (ii) is similar to (but easier than) the proof 
of Lemma 13.11 in IA.3I □ 

Now we can adapt the proof of Theorem 13.21 and obtain the first step of the reduction 
principle: 

Theorem 5.2. For all stopping times a, using the notation LB := (B 2 , B n _i), it 
holds that 



Z*{a) = esssup e(y(t)+e(z l ^( P ^)\F t 

TGSo-.disc \ 

yLB / n 



esssup E Y(t) + E(Z^ 1 (pf 1 )|JF r 

T&Sa 



Faj (28) 
F^. (29) 
□ 



In contrast to the model of Section 12.21 we obtain the second claim of the following 
Lemma immediately from the definition of the stopping problem (T2"6T) : 

Lemma 5.3. The process defined by 

^!(f):=E(z;£(pfO|^) (30) 
is a supermartingal Z n _ l with the following properties: 
(i) Z n _ x has a right- continuous modification Z^\. 
(ii) For all r G S with countable range it holds that 

Ztxir) = K.i(?) = E(z™(p*)\? T ). (31) 
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Proof. For allt > s > we have s < pf 1 < pf 1 and hence 



E(d(*)l^) = E(E(Z^(^)|^ fi ; 



Here (*) is valid since 

nz L n B Ap^)\F nBl . 



J r s)<Hz L n B 1 ( P ^)\F s ) = z B n _ 1 (s) 



E 



< E 



esssup E( Yjjj 



res™" 1 (LB) 



n-l 



esssup El Y 



r&S n -ULB) 



i=l 
n-l 



J 7 Bi 

Pt 



J 7 Si 

Pt 



J- B, 

Ps 



J 7 Si 

Ps 



(32) 



O(i0 



esssup El Y(rj 



reS""! (LB) 

«(pf). 



n-l 



i=l 



J 7 B 2 

Ps 



Now Property (i) holds by [KS88 ; , Theorem 3.13] and (ii) holds by the definition of 



7 B 



□ 



Therefore we obtain 



-F^B'r 



Theorem 5.4. Y n := Y^ := Y + Z^_i is an ^-adapted and right- continuous stochastic 
process and fulfills 

Z*{o) = esssup E(Y n (r)\T a ) (33) 



for all a G S. 



Proof. Applying Theorem 15.21 and Lemma 15.31 (ii) and using the right-continuity of Y n 
yields 



Z%(a) = esssup E(Y(t) +E{Z^ 1 (p^)\F T 

T"G<S CT ,disc 



esssup E(F„(r)|J 7 r 

T£<S CT , disc ^ 

esssup E( Y n {f)\T-, 



□ 



6. Example: Perpetual put option 

As an example we consider a perpetual put option with multiple stopping in a Black- 
Scholes market with waiting times depending on the asset price. To be more precise let 
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W be a Brownian motion and let $ be the right-continuous filtration generated by W. 
Furthermore let K, a> , E — (0, oo), h(x) = (K — a;) + and the asset price process A 
be given by 

A(t)=xexp(aW t + (J3-Y)t 
under F x . The reward process Y is given by 

Y(t) = e-f*h(A). 

For deterministic waiting times it can be shown that there exist x\ < x\ < ... < x* n 
such that the threshold times for A over Xj is the optimal time for the i-th exercise, 
see |CD08l Section 6.2]. But it seems very hard to determine xl,x%, ... explicitly in 
non-trivial examples. However we can find an explicit solution when dealing with some 
random waiting times in our second model: 

We set X = A and assume that between each two exercises we always have to wait until 
the process reaches a level z > K, i.e. Bi = [zq, oo) for all i. For the refraction times 
to be finite - see (I24|) - we assume that /3 > a 2 /2. Since the problem has a Markovian 
structure it is reasonable to use this as in Section HI The results and notations given there 
can immediately be taken over to the second model and we use them in the following. 
It is well-known that with only one stopping opportunity (i.e. n — 1) it is optimal to 
stop when the process reaches 

Xl ' l + a 2 /2/3' 
see e.g. |BL97j . Then for x < zq the function g[ Sl ^ is given by 

g{ 5l \x) := E x (e^ s W 1 (A(5 1 ))) = V 1 (z )E x (e-^) = Cl x, (34) 

and for x > z 

g[ Sl \x) :=^(x), 
. V 1 (z ) K-x\ fz o y 2r 

see e.g. |BS02j for the last equality in (13"4"1) . The explicit representation of g[ Sl ^ is the 
main reason why an explicit solution is possible in this example. Now note that 



where 
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Therefore we obtain c\ < 1 since zq > K. 

We concentrate on the case n — 2. In this situation the problem to be solved is given by 

Vi h \x) = supE^e-^ - A T ) + + g[ h) (A T ))) 
= supE z (e^ r h{A T )), 

T 

where the reward function h is a continuous functions given by 

(K-(l- a)x ,x<K, 
h(x) = < c\x , K < x < z , 

[Vi(x) = CiZq~ 7 X 7 , X > Zq. 

Obviously it holds that 

h{x) > (K - (1 - ci)x) + for all x. (35) 

On the other hand, 

su V E x (e^ T (K - (1 - Cl )A T ) + ) = supE (1 _ cl):E ( e -^(tf - A T ) + ) 

T T 

= V 1 ((l-c 1 )x). 

This shows that x h-» Vi((1 — Ci)a;) is /3-excessive and a majorant of /i. Therefore, keeping 
(1551) in mind, we obtain that 

^ l) (x) = V 1 ((l-c 1 )x). 

We see that for n = 2 it is optimal to stop the first time when the process started in 
(1 — c\)x reaches sc*, i.e. if the process started in x reaches 

„*_ ^ ^ 

a; 2 



1-d (1-c 1 )(1 + ( t 2 /2/3)' 
Now the optimal solution for n > 2 can be found the same way using induction. 
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A. Appendix: Some proofs 

A.l. Proof of Proposition 12.11 

(i) and (ii) are immediate from the definition. 
For (Hi) note that 

Qt +P \w=r} = cr({{(T + P < s}; s < t} \{ a=T } 
= ct({{t + p < s}; s < t} \ {a=T} 

= Ql +P \{a=r}, 

hence 

a(A t ,gr p ) \w=r } = a(A t ,gi +p )\ w=T} . 
To prove (iv) write range(a) U range(r) = {A^; i G /}, I countable. Then it holds 
{r + p<t} = |J {a = X l }n{r = Xj} D {Xj + p < t} 

U W = x l }n{r = x j }n{x l + p<t + x i -x J } 

i,j£l, \j<t 

a ^ T |J {a = A,;} n{T = Xj}n{<T + p<t + Xi- Xj} 

i,jei,Xi<\j<t 



therefore 



G (J rr(Av,Aw4;7,(' A ) C A, 

i,j&I,Xi<Xj<t 



v(A t , g T t +p ) = a(A t , {{r + p< s}, s < t}) C a(A t , A° t +f> ) = A^ p . 



A. 2. Proof of Lemma 12.2 



(i) : This is immediate by definition. 

(ii) : Write 

(P2, —iPn) :=^2l{r=A} + (A + 5i)l{ r ^ A }, ...,T n l{ T= A} + (A + Si + ... + 5n~l)l{r^A} 

For alH < A and i G {2, n} we have 

{Pi < t} = 0. 

Using Proposition I2.11 (iii) recursively we obtain for i > 3 

-7-.r+(5i,T2+52,...,Tj_i+(5i_i I - z -A+<5i,T2+<52,...,T i _i+<5i_i i 

A \{r=X}= J~t \{r=X} 
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n 

and using {r = A} C f| {r,- = pA we furthermore get 

3=2 

Therefore 

{pi<t} = {Til {T=X } + (A + 5i + ...+5i_i)l {r? 4A} <t} 

'{r = A} fl {r, < t}) U ({r ^ A} n {A + <5i + ... + 5^ < t} 



= ({r = A} n {t:, < £}) U ({r ^ A} n + c^i < t} 

^ ^1 A l{r=A}, -Tt K^A} 

= CT| J~t l{r=A}, A I{t^A} 

r- _/ t T r A+<5i,p2+<52v,Pi-i+<5i-i x-ft-i+^-i 

L (T[J-\,J- t ,J- t 



i 



Hence pi is an J A + 5 i>' 5 2+ 5 2' --,Pi-i+'5i-i_ s ^ ppi ri g time with p,_! + <^_! < p^ for z > 3. 
A similar argument also applies for i = 2. 

: This is immediate by applying (ii) to 

7"2l{r=A} + (T + ^l)l{r^A}> — , ^nl{r=A} + (t + &L + ••• + 5„_l)l{ r ^ A } 



: We first prove that for % > 2 

J7T+<5l,T2+<52,...,Ti+<5,; j-T + C+<5l,T2+C+<52,...,T 4 +C+(5i (36) 

The case % = 2 holds by 12.11 (ii). By induction we obtain again using Proposition 
O(ii) 

^.j J7T+C+<5l,T2+C+52,...,r i + C+(5 i ^T i + l+C+(5 i+ l 



hence 

■pT+Sl, T2+&2, — ,Ti+l+8i+l (- J^T + C+Sl,T2+C+S'2,.-.,Ti + l+C+S i + 1 

Therefore we obtain 

{ Ti + C <t} = { Ti < t -c} e jrr+^2+52,..,n. 1+ 5 1 . 1 Q Jc r +c+ S 1 ^ + c+6 2 ,...,r i . 1 +c+6 i - 1 ^ 

i.e. n + c is an ^+ c + 5 i.^+ c +< 5 2.---^-i+ c + 5 i-i- S topping time 
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A. 3. Proof of Lemma 13.11 

For r,pe S™{5) let 



1 v t=i ' ^ i=i 



and 



n. 



Vi := l^r, + 1a- Pi for z = 1, 

Then i/j is an ^-stopping time with a < V\ and Tj_x + < r, for all 2 £ {2, n}. To 
prove that Vi is an 3" ri+<5lv "' Ti - 1+,5 ^ 1 -stopping time for % — 2, n we first prove that 



Jr r 1+0l ,...,r^o 1 | An{(j ^ t} C jrn^l--^ for aU t > 0. 



ri+5i,...,rj+i5j | , r - jr^i+5i,...,i^+<5,: 

fi+<5i 



For all s < t it holds that J-* Un{o-<<} Q T% 1 and 

A n {a < t} n {n + s 1 < s} 
= A n {a < t} n A n {n + 5x < s} 

E afj^t, {An{r 1 + S 1 <r}; r <t} 



= a[jF tl {A n {a < r}; r < t}, {A n {n + 5i < r}; r < t} 
C <r(.F t , {AH {a <r}; r < t}, 

{(ac\{t 1 + 5 1 <r}VfA c n{pi + 5i <r}); r < t} 



<r(Ji, {A n {a < r}; r < t}, {{^ + ^ < r}; r < t} 
o{T u {{u 1 + S 1 < r}; r < t} 



and therefore 



i.e. 



i/i+(5i 



i/i+(5i 



For general i by substituting the sets {t\ + 5\ < s} by {r i+ i + 5 i+ i < s} in 
obtain that 



and by induction 



An {a <t} n {r l+1 + 5 i+1 <s}e a{T t , 



-T-.ri+(5i,...,Ti + i+(5i + i I 7 -.!/i+(5i,...,u i+ i+5 i+ i 
A Un{ff<t} i= A 



(37) 



(38) 



we 



Analogously we obtain 
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rrPl+S\, — ,Pi+5i I (— -pV\+&l,---,Vi+&i 

J~ t \A c n{a<t} i= J~ t 

and therefore 



{v t + 5 t <t} = (ah { n + 5 t < o) u (a c n { Pl + 5 t < o) 

An{a<f}n {ri + <jj < £}) u (V n {a < t} n {p* + $ < t}) 



,- / -l~Tl+Sl,...,Ti-l+6i-l I -T--/9l+<5i,...,pi_i+<5i-l I 

£ Un{<7<<}) U c n{o-<t} 

This proves that {v\, u n ) e <S™ (5) and it holds that 

This proves the first statement. For the second assertion note that if range (ri) and 
range(pi) are countable, then so is range^), i.e. by the proof above (z/ 1; v n ) e 

5™(5)disc- 
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